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DETAILED ACTION 

1 . This office action is responsive to application 10/81 1 ,861 filed on March 30, 
2004. Claims 1-10 are pending in the application and have been examined by the 
examiner. 

Priority 

2. Receipt is acknowledged of papers submitted under 35 U.S.C. 1 19(a)-(d), which 
papers have been placed of record in the file. 

Claim Objections 

3. Claim 3 is objected to because of the following informalities: Lack of clarity and 
precision. Claim 3 recites a "JEEG codec". Please change claim 3 to read "a JPEG 
codec". Appropriate correction is required. 

Claim Rejections - 35 USC § 103 

4. The following is a quotation of 35 U.S.C. 103(a) which forms the basis for all 
obviousness rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or described as set 
forth in section 102 of this title, if the differences between the subject matter sought to be patented and 
the prior art are such that the subject matter as a whole would have been obvious at the time the 
invention was made to a person having ordinary skill in the art to which said subject matter pertains. 
Patentability shall not be negatived by the manner in which the invention was made. 

5. The factual inquiries set forth in Graham v. John Deere Co., 383 U.S. 1, 148 
USPQ 459 (1966), that are applied for establishing a background for determining 
obviousness under 35 U.S.C. 103(a) are summarized as follows: 

1 . Determining the scope and contents of the prior art. 

2. Ascertaining the differences between the prior art and the claims at issue. 

3. Resolving the level of ordinary skill in the pertinent art. 

4. Considering objective evidence present in the application indicating 
obviousness or nonobviousness. 
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6. Claims 1-10 are rejected under 35 U.S.C. 103(a) as being unpatentable over 
Kim(US 2003/0179939) in view of Lim(US 2004/0204144), and further in view of Tang 
et al.(US 2004/0061902). 

Consider claim 1 , Kim teaches: 

A digital camera image controller apparatus for a mobile phone(figures 1 and 2, 
paragraphs 0003-0005, and 0029), comprising: 

an LCD module(302, figure 2), as a display means of the mobile phone, to 
display information for communication(The display means displays both image and 
graphics data, paragraphs 0041, 0058-0061. Communication information is commonly 
displayed as graphics data in a mobile device.); 

a sensing modulefCMOS Image Sensor", 305, figure 2), to sense optical signal 
of an external image and accordingly produce an RGB image signal(paragraph 0038); 
and 

an image controller(The image controller has many parts, figures 1 and 2.), 
having: 

an RGB-to-YUV converter("pre-processor", 30, paragraph 0038), to convert the 
RGB image signal into a YUV image signal(paragraph 0038); 

a YUV-to-RGB converter("post-processor", 40, paragraph 0041), to convert the 
YUV image signal into the RGB image signal(paragraph 0041); 
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a compression engine("Encoder/Decoder", 70, paragraph 0039), to compress or 
decompress the YUV image signal in order to produce a compressed or decompressed 
YUV image signal(paragraph 0039); and 

a buffer("First SDRAM", 306, and "Second SDRAM", 308, paragraph 0069), to 
temporarily store the RGB image signal and the compressed YUV image signal(The two 
SDRAM's are used to store and retrieve the image data, paragraph 0069. Cache 
memory(60) can also be used as a buffer, paragraph 0046 ), 

wherein the RGB image signal in the buffer is able to directly display on the LCD 
module(paragraph 0069). 

Kim teaches of a processor for a multimedia device(paragraph 0003). Kim also 
teaches that said multimedia device can be a mobile phone(paragraph 0005). 
However, Kim does not explicitly teach a baseband processor, connected to circuit of 
the mobile phone in order to perform required communication processing. Also, 
because Kim does not explicitly teach the baseband processor, Kim does not teach that 
the compressed YUV image signal in the buffer is sent to the baseband processor for 
further processing. 

Lim is similar to Kim in that Lim deals with an image sensor which can be a 
CMOS image sensor(paragraph 0035). Lim is further similar in that captured YUV 
image data is converted into RGB data in order to be displayed on a display(paragraph 
0040). Likewise, Lim teaches that the image sensor is in a mobile device(paragraph 
0032). 
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However, in addition to the teachings of Kim, Lim teaches a baseband 
processor("RF module", 21 , figures 1 and 5), connected to circuit of the mobile phone in 
order to perform required communication processing( Paragraphs 0037 and 0038. The 
RF module(21) performs both voice communication and image transmission/reception.). 
Lim also teaches that the compressed YUV image signal in the buffer is sent to the 
baseband processor for further processing(YUV data, the image data obtained by the 
camera, is sent to the RF module where it is further processed by being transmitted. 
RGB data is simply used for image display, paragraphs 0037-0040.). 

Therefore, it would have been obvious to a person having ordinary skill in the art 
at the time of the invention to connect the mobile camera apparatus taught by Kim to a 
baseband processor taught by Lim in order to perform high-speed data transmission of 
images from remote locations via a readily accessible communication network(Lim, 
paragraphs 0005 and 0006). 

However, the combination of Kim and Lim does not explicitly teach of a color 
interpolation device, to interpolate color for each pixel of the RGB image signal 
produced by the sensing module and thus obtain an interpolated RGB image signal with 
complete color information. 

Tang et al. is similar to Kim in that Tang et al. teach of obtaining raw images from 
a sensor, which images have one color space(i.e. RGB or YUV), converting those 
images to a second color space(i.e. RGB or YUV), and outputting the images(figure 
12A, paragraphs 0003, 0064-0066). 
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However, in addition to the combined teachings of Kim and Lim, Tang et al. teach 
of a color interpolation device(912, figures 12a and 12b), to interpolate color for each 
pixel of the RGB image signal(paragraphs 0046-0050, figure 12b) produced by the 
sensing module("sensor data", 910, figure 12a) and thus obtain an interpolated RGB 
image signal with complete color information(paragraphs 0064-0066). 

Therefore, it would have been obvious to a person having ordinary skill in the art 
at the time of the invention the have a color interpolation device as taught by Tang et al. 
for interpolating color for each pixel of the RGB image signal taught by the combination 
of Kim and Lim, for the benefit of obtaining correct color information, and generating 
color images which have full resolution(Tang et al., paragraph 0002). 

Consider claim 2, and as applied to claim 1 above, Kim teaches that the 
sensing module includes a sensor(305) to collect optical signals of the external image 
and sense the optical signal for producing the RGB image signal(paragraph 0038). Kim 
does not explicitly teach that the sensing module includes a lens. 

However, Official Notice (MPEP § 2144.03) is taken that both the concepts and 

* 

advantages of including a lens along with the image sensor in a sensing module are 
well known and expected in the art. It would have been obvious to a person having 
ordinary skill in the art at the time of the invention to include a lens to direct light onto 
the image sensor taught by Kim in order to properly direct the light and obtain a clear, 
in-focus image, representative of the actual photographed environment as seen by the 
user. 
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Consider claim 3, and as applied to claim 1 above, Kim teaches the compression 
engine is a JPEG codec(paragraph 0040). 

Consider claim 4, and as applied to claim 1 above, Kim teaches a sensor 
interface connected to the sensing module(The pre-processing circuit(30) provides an 
interface between the image sensor(305) and second system bus(9). See figure 2). 

Consider claim 5, and as applied to claim 1 above, Kim teaches a display 
interface(44) connected to the LCD module(302, paragraph 0061 ). 

Consider claim 6, and as applied to claim 1 above, Kim does not explicitly teach 
a host interface connected to the baseband processor. 

Lim teaches a host interface(0023) connected to the baseband processor(0021, 
paragraphs 0037-0038). 

Consider claim 7, and as applied to claim 1 above, Kim teaches in operating, 
both the RGB image signal and the compressed YUV image signal temporarily stored in 
the buffer come from the sensing module(The RGB data comes from the sensing 
module, and the YUV data is derived from the RGB data. Therefore, the YUV data 
comes from the sensing module as well, paragraph 0038.). 
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However, the combination of Kim and Lim does not explicitly teach that the RGB 
data is interpolated data. 

Tang et al. teach of interpolation(see claim 1 rationale). 

Consider claim 8, and as applied to claim 1 above, Kim teaches of a decoder 
circuit(70) for decoding compressed image data(paragraphs 0039-0040). However, Kim 
does not explicitly teach that the image data comes from a baseband processor. 

Lim teaches in operating, both the RGB image signal and the compressed YUV 
image signal temporarily stored in the buffer come from the baseband processor(Lim 
teaches that image data can be transmitted/received via the RF module(i.e. the 
baseband processor). See paragraphs 0037-0038, claim 1 rationale.). 

However, the combination of Kim and Lim does not explicitly teach that the RGB 
data is interpolated data. 

Tang et al. teach of interpolation(see claim 1 rationale). 

Consider claim 9, and as applied to claim 1 above, Kim teaches of displaying an 
image on the LCD(see claim 1 rationale). Kim further teaches of a decoder circuit(70) 
for de-compressing image data(paragraphs 0039-0040). Kim also teaches that image 
data is stored and retrieved from SDRAMs 306 and 308. Kim teaches of directly 
displaying an image, which exists in the mobile phone, on the LCD module through the 
image controller(Kim teaches that input image data, stored on the phone in SDRAM, is 
directly displayed on an LCD unit, paragraph 0069 ), without activating the color 
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interpolation device, RGB-to-YUV converter and compression engine of the image 
controller and the sensing module(Kim teaches that input image signals are 
decompressed, sent to the post processor, and displayed, paragraphs 0068-0069. The 
post processor circuit is the YUV-to-RGB circuit(see claim 1 rationale). Therefore, when 
directly displaying the image signal, the RGB-to-YUV converter, compression engine, 
sensing module, and any color interpolation devices are not activated.). 

However, Kim does not explicitly teach that the image data comes from a 
baseband processor. 

Lim teaches the image data comes from the baseband processor(Lim teaches 
that image data can be transmitted/received via the RF module(i.e. the baseband 
processor). See paragraphs 0037-0038, claim 1 rationale.). 

However, the combination of Kim and Lim does not explicitly teach that the RGB 
data is interpolated data. 

Tang et al. teach of interpolation(see claim 1 rationale). 



Consider claim 10, and as applied to claim 1 above, the combination of Kim and 
Lim does not explicitly teach a color correction device arranged in between the color 
interpolation device and RGB-to-YUV converter to correct nonlinear color response due 
to the electronic sensor characteristics and different light sources. 

However, Tang et al. teach a color correction device(914, figure 12a) arranged in 
between the color interpolation device(912) and RGB-to-YUV converter(920) to correct 
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nonlinear color response due to the electronic sensor characteristics and different light 
sources(See figure 12a, paragraph 0004.). 

Any inquiry concerning this communication or earlier communications from the 
examiner should be directed to Albert H. Cutler whose telephone number is (571)-270- 
1460. The examiner can normally be reached on Mon-Fri (7:30-5:00). 

If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, Ngoc-Yen Vu can be reached on (571 )-272-7320. The fax phone number 
for the organization where this application or proceeding is assigned is 571-273-8300. 

Information regarding the status of an application may be obtained from the 
Patent Application Information Retrieval (PAIR) system. Status information for 
published applications may be obtained from either Private PAIR or Public PAIR. 
Status information for unpublished applications is available through Private PAIR only. 
For more information about the PAIR system, see http://pair-direct.uspto.gov. Should 
you have questions on access to the Private PAIR system, contact the Electronic 
Business Center (EBC) at 866-217-9197 (toll-free). If you would like assistance from a 
USPTO Customer Service Representative or access to the automated information 
system, call 800-786-9199 (IN USA OR CANADA) or 571-272-1000. 
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